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Summary 

Up to now, meta-analysis has rarely been used in epidemiology and no generally accepted 
standards are available. Combining risk estimates from biased or confounded studies by, 
meta-analysis cannot provide correct answers. 

In our paper two cohort and ten case-control studies were analyzed using several 
statistical techniques (Fisher, Mantel-Haenszel, Yusuf)- Only data from women were 
included and a quality indicator (histology exposure, methodology) was used to analyze 
different study combinations, i.e. an analysis of sensitivity was performed. For the 
Hirayama study two different risk estimates were used. In addition, all 1,023 logically 
possible combinations of the 10 case-control studies were analyzed. 

Of all possible meta-analyses of the 10 case-control studies, 670 (65.5%) were not 
significant at PS 0.05 (Yusuf technique). The Trichopoulos study is involved in 330 of the 
353 significant study combinations, indicating that this is the dominating case-control 
study, although the methodological quality is unacceptable. 

Combining case-control and cohort studies, the relative risk estimates range from 
1.013 to 1.118, depending on the specific subset of studies analyzed. These relative risk 
estimates include unity. The quality of the individual studies is highly variable and 
sometimes poor. We conclude that as long as no better studies are available, meta¬ 
analyses cannot and do not add much new evidence to the question of whether passive 
smoking is related to lung cancer. 

Up to now, meta-analyses have mainly been used with randomized clinical trials. The 
technique has been criticized [6* 10,23] for various reasons. Standards for meta-analyses 
in epidemiology are not yet available. Bias by non-reporting of studies, by selecting 
certain subgroups or by redefining sample sizes can create additional difficulties for a 
statistical evaluation. How different study designs - e.g. case-control versus cohort' 
studies - should be weighted is left to the investigator. It is not surprising that the 
application of such methods in a controversial field like passive smoking and lung cancer 
does not come up with uniform results. 

The inclusion of studies in meta-analyses is justified as long as there are no major 
methodological shortcomings in the individual studies. Combining biased or con¬ 
founded results by meta-analysis cannot provide correct answers. There is a strong case 
for an analysis of sensitivity [23]. It investigates the effect of different study selections as 
well as the impact of different statistical methods on the results. 

When the first papers on passive smoking and lung cancer were published a serious 
hypothesis was created [11, 27]. This hypothesis is serious because - if it is right - 
thousands of non-smokers are being killed worldwide by smokers. But the hypothesis is 
also serious because - if it is wrong - smokers are being accused of killing other people 
without actually doing so. 
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Last year Wald [31] published the first meta-analysis of the available studies on 
passive smoking and lung cancer. In his paper the results obtained in men were included, 
and in two studies the subgroup of women married to ex-smokers was excluded. The 
quality of the individual studies was not taken into account and no analysis of sensitivity 
was performed. 

Every meta-analysis has to state its goals, criteria and methods before it starts. In our 
analysis we planned 

1) to include only studies which fulfil minimal methodological requirements. We wanted 
to eliminate statistical noise. 

2) to select carefully the “best" relative risk estimate from every study, not just the one 
which was reported by the authors or the highest one. 

3) to classify the quality of the studies regarding determination of histology, estimation 
of exposure and overall study methodology. 

4) to use different statistical techniques, namely the Fisher method and the method used 
by Yusuf [32] ior Wald [31]. 

5) to study the sensitivity of the results with regard to including different subsets of 
studies depending on their qualities. 


Selection of Studies 

We did not include the studies by Gillis [9], Knoth [16], Millfer [22] and Sandler [24^26]. 
These studies do not fulfil minimal methodological criteria and they do not contain 
relevant information. Only insufficient data are available from them. Wald [31] had 
included the Gillis study [9]; which only has 14 non-smoking lung cancer cases and 
correspondingly wide confidence intervals contributing nothing to the available 
evidence. 

We also excluded men because the majority of evidence comes from studies in women. 
Only about 11% of the reported cases are men. Their results vary widely. There is not a 
single significant result in men. The situation regarding biology, exposure and reporting 
habits is considerably different'in men as compared to women. 

We included two cohort studies [7,12-14] and 10 case-control studies [ 1-5,8,15,17, 
19-21, 27, 28]. These studies had also been included by Wald [31]. The only difference is 
that we didn’t include the Gillis study [9] and that we restricted our analysis to women. 
The availability of histology,, the quality of the exposure indicator and an overall quality 
rating of the study were judged by K. Oberla. Three study groups resulted: cohort studies, 
case-control studies with reasonable quality (quality +) and case-control studies with 
poor quality (quality —) (Table 1). 

The 2 X 2 tables and RR estimates for the 12 studies used are presented in Table 2. 
Generally,, these numbers are the same as used by Wald [31] with the exception that we 
did not exclude the wives of ex-smokers in the studies by Hirayama [14], Trichopoulos 
[27,28] and Koo [17]. 

Regarding the Hirayama study we did not use a relative risk estimate of 1.63 as did 
Wald [31]. In a subsequent paper by Oberla and Ahlboro [30]j which will be presented in 
this session of the conference, it is shown that, when one adjusts the Hirayama cohort to 
the age of the female population in Japan, the relative risk is 0.90. We alternatively used a 
risk estimate ofl.45 for the Hirayama study. This was calculated from Table 2 of the 1984 
publication by Hirayama [13] and was standardized by the age of women only. 
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Table L Quality rating of studies selected for meta-analyses 

Author 

Histology 

Exposure 

Quality 

rating** 

Resulting group 

Hirayama 

_ • 

- 

3 

Cohort' 

Garfmkel 

— 

— 

2 

Cohort 

Chan et al. 

+ 

+ 

4 

CC quality -K 

Correa et al. 

— 

— 

5 

CC quality - 

Trichopoulos et al. 

- 

- 

6 

CC quality — 

Bufller et alj 

+ 

— 

A 

CC quality + 

Kabat et al. 

+ 

+ 

4 

CC quality + 

Garfinkel et al. 

+ 

+ 

4 

CC quality + 

Akiba et al. 

— 

— 

5 

CC quality — 

Lee et al. 

- 

+ 

5 

CC quality — 

Koo et al. 

+ 

-H 

4 

CC quality + 

Persbagen et al. 


+ 

4 

CC quality : + 


The included studies arc the aame as in the paper by Wald el al. (1986). We included women only. 
•* 2 = acceptable; 3 = possibly flawed; 4 = bias and confounding suspected; 5 = major bias and 
confounding suspected; 6 = unacceptable 


Table 2. 2X2 Tables and relative risk estimates for studies selected for meta-analyses 

Author 

Exposed lung cancer 

Unexposed lung cancer 

Relative 

risk 


+ 

- 

+ 

- 


Hirayama 

163 

69.428 

37 

21,858 

L43(l): 






0.90(2): 

Garfmkel 

88 

127,164 

65 

49,422 

1J8 

Chan et al. 

34 

66 

50 

73 

0.75 

Correa et al. 

14 

61 

8 

72 

2.03 

Trichopoulos et al. 

53 

• 116 

24 

109 

2.01 

Buffler et al. 

33 

164 

8 

32 

0.80 

Kabath et al. 

13 

15 

11 

10 

0.79 

Garfmkel et al 

91 

254 

43 

148 

1.23 

Alciba et al. 

73 

188 

21 

82 

1.48 

Lee et al. 

22 

45 

10 

21 

1.03 

Koo et al. 

66 

97 

22 

40 


Persbagen et al. 

33 

150 

34 

197 

1.27 


The underlined numbers are different from those assumed by Wald. We did not exclude the wives 
of ex-smokers. 

(1) Hirayama standardized by age of women only (from Table 2* Hirayama 1984) 

(2) Hirayama with age selection bias removed (Oberla and Ahlborn^ 1987) 
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Results 

Meta-Analyses for All Possible Case-Control Study Combinations 

In order to get a feeling for the consequences of random selection of studies, we first 
considered all possible combinations of case-control studies. With 10 case-control 
studies there are 1,023 possible study combinations or subsets for which a meta-analysis 
j can be performed! We calculated them all. The results can be summarized as follows: 

i 34.5% of all possible meta-analyses - using the Yusuf technique - are technically 

significant at p £ 0.05. That means that a random selection of studies leads to a 
probability of 65.5% for a negative result of the meta-analysis. 

The Trichopoulos study is involved in 330 of the 353 significant study combinations, 
that is in 93.5%. This study is the dominant study in the significant combinations. 
; Without the Trichopoulos study only 23 out of the 511 then possible study combinations 

j are “significant", that is 4.5%. One has a probability of 95.5% for a negative result 

« selecting a subset of studies for a meta-analysis randomly. 

The Trichopoulos study was judged as methodologically unacceptable. It is a 
! textbook example of how a case-control study should not be performed [29]J If it were 

included, however, the impact of this study on the results would prove to be heavy. 


Table 3. Result* of meta-analyses I 


Author 

Cohort 

only 

Case-control 
quality + 

Case-control 
quality — 

Cohort plus 
CC quality 4i 

All 

Hirayama* 

X 



X 

X 

Garfinkel 

X 



X 

X 

Chan 


X 


X 

X 

Correa 



X 


X 

Trichopoulos 



X 


X 

Bufller 


X 


X 

X 

Kabath 


X 


X 

X 

Garfinkel 


X 


X 

X 

Akiba 



X 


X 

Lee 



X 


X 

Koo 


X 


X 

X 

Penhagen 


X 


X 

X 

Fisher: p 

0.017 

0.604 

0.007 

0.137 

0.009 

Yusuf: RR 

1.271 

1.074 

1.652 

1.178 

1.260 

IL95 

1.025 

0.848 

1.201 

1.005 

li093 

IU95 

1.575 

1.361 

2.272 

1.381 

1 453 

P** 

0.014 

0.277 

0.001 

0.022 

0.00! 


* Hirayama standardized by age of women only, RR — 1.45 as calculated from Table 2, 
Hirayama, 1904 
*• one-tailed 


i 
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Table 4. Results of meta-analyses II 


Author 

Cohort 

only 

Cohort plus 

CC quality + 

All without 
Trichopoulos 

All 

Hirayama adjusted* 

X 

X 

X 

X 

Garfmkel 

X 

X 

X 

X 

Chan 


X 

X 

X 

Correa 


- 

X 

X 

Trichopoulos 


- 

- 

X 

Buffer 


X 

X 

X 

Kabath 


X 

X 

X 

Garfmkel 


X 

X 

X 

Akiba 


— 

X 

X 

Lee 


- 

X 

X 

Koo 


X 

X 

X 

Perehagen 


X 

X 

X 

Fisher, p 

0.105 

0-336 

0.158 

0.028 

Yusuf: RR 

1.013 

1.035 

1.076 

1.118 

IL95 

0.848 

0.941 

0.941 

1.273 

IU 95 

1.210 

1.193 

1.230 

1.299 

P~ 

0.443 

0.317 

0.142 

0.046 


* With age selection bias removed. RR = 0.902 (Oberla and Ahlborn 1987) 
** one-tailed 


Meta-Analyses for Selected Study Groups 

Meta-analyses for various combinations of cohort and case-control studies were 
calculated. Tbe results are given in Table 3. For the Hirayama study a relative risk of 1.45 
for the exposed versus non-exposed persons is used in all these combinations as one of the 
starting points. The results show that the probability using the Fisher method is always 
higher than the probability using the procedure as applied by Yusuf [32] or Wald [31]. 
This had to be expectedj The other methods - Mantel-Haenzsel or for the cohort studies 
risk ratios - do not differ much from the Yusuf method: All the study combinations on 
Table 3 are significant with the exception of the reasonable quality case-control studies. 
These six studies have a common risk estimate of 1.07, being not statistically different 
from unity. 

The meta-analyses for these study combinations were repeated using a relative risk of 
0.90 for the Hirayama study as was calculated by Uberla and Ahlbora [30]. The pooled 
risk estimates are very close to unity and are not statistically significant (Table 4). When 
one includes the Trichopoulos study, the pooled estimate for the relative risk is 1.118, 
approaching but not reaching statistical significance. 
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Discussion 

To summarize, the expected overall risk of dying of lung cancer for non-smoking women. 
married to smoking men is: 

- 1.074 out of six case-control studies of reasonable quality, 

- KOI 3 out of two prospective studies, using the Hirayama study with the age selection 
bias removed as shown by Cberla and Ahlbom, 

- 1.035 out of two prospective studies and six case-control studies of reasonable quality, 

- 1.076 out of eleven studies, with the Trichopoulos study excluded, and 

- 1.118 out of all twelve studies including the Trichopoulos study. 

These risk estimates are not statistically different from unity. 

Thus, the overall result of various meta-analyses can be summarized as follows: Meta- 
analysis of 12 relevant studies (using women only and adjusting the relative risk of 
Hirayama for age selection bias) gives an overall estimate of rejative risk of dying of lung 
cancer for nonsmoking women married to smoking men of RR = 1.076 (Trichopoulos 
excluded) or RR — 1.118 (Trichopoulos included). These risk increases of about 8 % or 
12% are not significantly different from unity. 

Our results differ widely from the results given by Wald [31). The main reasons are 
different relative risk estimates for the individual studies. The papers by Hirayama and 
Trichopoulos were the first studies to be published on this issue. All later studies give less 
indicative results. Whether wives of ex-smokers should be included or not^ whether the 
Hirayama study has to be adjusted for age selection bias and whether the Trichopoulos 
study is methodologically as stringent as a case-control study should be is open, for 
discussion and will be answered differently by individual scientists. We have shown a 
variety of possible outcomes of meta-analyses and demonstrated the sensitivity of the 
results with varying assumptions. 

The whole question of meta-analyses comes down to the question of the quality of the 
individual study. As long as there are no better studies available, meta-analyses cannot 
and do not add much new evidence to the question whether passive smoking is related to 
lung cancer. 
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